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SUBSTITUTE SPECIFBCATIOM 
METHOD OF TRADING INFORMATION 
BACKGROUND OF THE INVENTION 
The present invention relates to a method of trading image information, such 
as still images, movie images or the like, via communications means, such as the 
5 internet or the like; and, more particularly, the invention relates to a method of 
trading image information in which the reliability of the image information, such as 
the authenticity of the information, prevention of falsification of the information and 
the like, is improved, and to industrial products to which this image information is 
appended. 

10 

Conventionally, in the handling of images and image information in the field of 
information communications, and especially in connection with communication on 
the internet, various methods for preventing falsification have been proposed in order 
to prevent copyright violations and the like. For example, measures for preventing 
15 falsification, such as encoding using the inverse function of a one-way function 

based on a decryption key on images input from a digital image recording apparatus 
and the like, are described in Japanese Patent Application Laid-Open No. H11- 
98461. 

Such electronic signature methods constitute security systems for images that 
20 are transmitted and received via the internet or the like; however, such systems have 
no effect in cases where a falsification of information is made prior to the electronic 
signature processing that is performed before the data is stored in the PC used for 
anti-falsification processing from the digital image recording apparatus prior to 
transmission or reception. 
25 As an example of the application of image information, in cases where the 

welded portions of metal parts are to be inspected by a non-destructive inspection, 
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an inspection that is performed in order to discover fissures, cracks or the like 
occurring in the welded portions of such metals or the like is currently accomplished 
by means of visual inspection performed by an inspector. A nondestructive method 
in which an inspection for defects in the welded surfaces is performed using digital 
5 images or the like relating to the metal surfaces is also conceivable as a means of 
carrying out such an inspection. 

In cases where an inspection is performed by transmitting such image 
information via the internet, it is necessary to ensure the reliability and authenticity of 
the image information that is inspected, to determine whether or not this information 
10 comprises images that were obtained by properly imaging the object, and whether or 
not the images were falsified. 

Specifically, in order to perform various types of inspections using image 
information typified by digital still images, it is necessary to make it possible to 
confirm that the images have not been falsified from a time immediately following the 
15 imaging of the images by an imaging device, such as a digital camera or the like. 

SUMMARY OF THE INVENTION 
The present invention provides a method of trading image information which 
makes it impossible to falsify images once these images have been imaged, and 
which makes it possible to confirm that such images have not been falsified following 
20 imaging. 

Specifically, in accordance with the present invention, the place and time at 
which images are obtained can be clearly specified by receiving a JJY standard 
frequency transmitted from Communications General Laboratories or a GPS (global 
positioning system) satellite wave, and adding accurate and precise information 
25 regarding time and place to the image information, so that reliable image information 
is obtained. Furthermore, the reliability of such image information can be further 
increased by adding imaging information regarding air temperature, humidity, 
altitude, environment, sound and the like. Moreover, the method of the present 
invention is devised so that data that allows identification of the camera used in 
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imaging and the person performing this imaging can also be added to the image 
information. 

Furthermore, falsification can be prevented by a circulation system in which 
the image information is controlled and circulated by a specified organization or 
5 association, and various types of visual inspections or the like can be widely carried 
out in all types of fields as a result of the acquisition of reliability by such image 
information. 

These and other objects, features and advantages of the invention will be 
apparent from the following more particular description of preferred embodiments of 
10 the invention, as illustrated in the accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 
Fig. 1 is a diagram which shows one embodiment in which the image 
information of the present invention is applied to a piping installation; 

Fig. 2 is a diagram which shows one embodiment in which the image 
15 information of the present invention is applied to a construction project; 

Fig. 3 is a diagram which shows one embodiment in which the image 
information of the present invention is applied to food processing; 

Fig. 4 is a diagram which shows one embodiment of image acquisition means 
which make it possible to create the image information of the present invention; 
2 0 Fig. 5 is a block diagram which shows one embodiment of image acquisition 

means which operates to create the image information of the present invention; 

Fig. 6 is a diagram which shows one embodiment of the construction of a 
system for trading the image information of the present invention; 

Fig. 7 is a flow chart which shows one example of the flow of information in a 
2 5 system for trading the image information of the present invention; 

Fig. 8 is a flow chart which shows another example of the flow of information 
in a system for trading the image information of the present invention; 

Fig. 9 is a flow chart which shows another example of the flow of information 
in a system for trading the image information of the present invention; 
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Fig. 10 is a diagram which shows one embodiment of the information search 
system of the present invention; 

Fig. 1 1 is a diagram which shows one embodiment in which the image 
information of the present invention is applied to the prevention of falsification of 
5 images; 

Fig. 12 is a block diagram which shows one embodiment of image acquisition 
means which operates to create the image information of the present invention; and 

Fig. 13 is a diagram which shows one embodiment of an inspection warning 
to which image information of the present invention has been appended. 
10 DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Embodiments of the present invention will be described below with reference 
to the attached figures. 

Fig. 1 shows an example in which information regarding the conditions of a 
welding inspection of metal piping 109, which is used in a large installation, such as 
15 a generating plant or the like, and which is imaged by means of a digital camera, is 
expressed as image information in accordance with the present invention. In this 
metal piping 109, three pipes are connected by welding; and, the reference numeral 
110 indicates the welding marks at the joints between these pipes. In order to 
inspect for welding defects in the welding marks 1 10, a penetrating damage-locating 
2 0 test treatment is performed, and defective areas, such as fissures, cracks or the like, 
can be observed by means of a red pattern. 

Furthermore, it would also be possible to perform a magnetic powder 
damage-locating treatment, instead of a penetrating damage-locating treatment. In 
this case, the regions including the welding marks 110 are illuminated with ultraviolet 
2 5 light, and the fluorescence generated by defective areas, such as fissures, cracks or 
the like, can be detected. 

In regard to the installation image information 101, along with an image of the 
metal piping 109, imaging time information 102, position information 105 indicating 
the imaging location in terms of latitude and longitude, imaging environment 
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information acquired at the time of imaging, such as air temperature information 103, 
humidity information 104, illumination information 106, air pressure information 107 
and altitude information 108, an identification code (not shown in the figures) for the 
digital camera which is used, the name and identification code (not shown in the 
5 figures) of the person performing the imaging and the like, are displayed in an 
environmental information region 111 within the same image. 

The displayed time information 102 constitutes information obtained by 
receiving a JJY standard frequency. Furthermore, in the case of the location 
information 105, highly precise information from a GPS satellite wave is acquired, 

10 calculated and recorded. In the still images of the digital camera according to this 
example, environmental information is added at the time of imaging; however, in the 
case of moving images, environmental information during image recording is 
continuously written. 

The time information and position information is highly reliable information as 

15 a result of the use of accurate and precise information that is public information. In 
the example of Fig. 1 , the location of the plant in which the metal piping 109 was 
present, and the location of the installation within the plant, can be specified from the 
position information 105 obtained from a GPS satellite wave. Furthermore, the 
manufacturing process step through which the metal piping 109 was passing at the 

20 time of imaging can be ascertained from the time information 102. As a result, the 
origin of the installation image information 101 is clear in terms of which piping was 
in which state, so that this information is endowed with reliability. As a result of the 
information relating to place and time thus being strictly specified, the images 
constitute information in an extremely limited narrow space, and, therefore, the 

25 images have a genuineness that allows no room for the entry of other falsifying 
factors, so that the images have a high added value. 

To describe this feature in more detail, when the time information 102 of the 
installation image information 101 of the present embodiment is compared with a 
manufacturing process table (not shown in the figures) or the like which specifies the 
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processing of the metal piping 109, it can be confirmed that the current state is a 
welding inspection state. Furthermore, from the position information 105 and a layout 
diagram (not shown in the figures) of the interior of the plant or the like, it can also be 
confirmed which part of which installation contained the piping parts, and it can be 
5 verified from the time and position information that the installation image information 
101 does not comprise spurious images. 

By using the highly reliable image information of the present invention, it is 
possible to perform an inspection for defects in the welding marks 110 indirectly 
using the installation image information 101. In conventional inspections for defects 

10 in welding marks, an inspector possessing the necessary qualifications for 

performing such inspections repeatedly visits the site of the piping and makes a 
visual inspection; however, if image information is used, instantaneous transfer is 
possible, so that inspection and confirmation can be accomplished without the 
inspector being on-site. Even in a remote location, an inspector can perform an 

15 inspection for defects by looking at the welding marks 1 10 in installation image 
information 101 that is displayed on a screen or has been printed out. 

Furthermore, a quantitative evaluation of a defect inspection can be 
performed instead of a visual inspection by performing a defect inspection using 
image processing from images displayed in the image region 112. In this case, in 

2 0 order to perform image processing with a correct evaluation of the resolution of the 
images that are imaged by the digital camera, the installation image information 101 
must include an image obtained by imaging a resolution evaluation sample with the 
digital camera, along with an image of the welding marks 110. 

Furthermore, for example, in cases where defects or problems are discovered 

2 5 following the completion of the installation of the metal piping 1 09, the cause of such 
problems can be inferred from the information regarding air temperature 103, 
humidity 104, air pressure 107 and altitude 108 within the installation image 
information 101, so that the installation image information 101 also has a high utility 
value in terms of maintenance. 



7 



Furthermore, in cases where changes in the metal piping 109 over time are 
monitored using the installation image information 101, new installation image 
information 101 at the current point in time can be obtained under the same 
conditions as at the time of previous imaging by calling up previously imaged and 
5 stored installation image information 101, and using the information regarding the 
data and time of previous imaging and environmental conditions at the time of 
previous imaging that have been recorded in this previous installation image 
information 101. As a result, a plurality of sets of installation image information 101 
that have been imaged over time can be compared in a simple manner, so that the 

10 changes in the metal piping 109 over time can easily be evaluated. 

In regard to methods used to call up previously imaged and stored installation 
image information 101, a personal computer connected to the internet or a mobile 
telephone equipped with an internet function may be used. The installation image 
information 101 that is called up is displayed on the screen of the personal computer 

15 or mobile telephone. 

Fig. 2 shows an example in which the construction of the foundation of a 
building is represented as image information in accordance with the present 
invention, which information is obtained from construction processes imaged by a 
digital camera. In the construction image information 201, the conditions of the 

20 construction of the foundation part 206 of the building that is under construction 
outdoors are displayed together with environmental information regarding the time 
202, air temperature 203, humidity 204, wind velocity 209, and latitude and longitude 
205. This environmental information indicates the following: first of all, the position 
205 indicates which building is involved, and the time 202 indicates the conditions of 

25 progress in the construction process. Accordingly, the images and the building can 
easily be compared. 

Furthermore, using the time information 202, confirmation can be made from 
the number of steel re-bars 207 and the like in the foundation part 206 of this 
building as to whether or not construction standards, such as the required number of 
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re-bars and the like, have been satisfied. Moreover, if the distribution of the 
hardening material 208 is recorded in the images at the same time, concerns about 
strength on the part of the builder can be assuaged, and doubts about illegal 
construction can also be eliminated, so that the reliability of the building construction 
5 can be established. Furthermore, anxiety and distrust can be eliminated by 
disclosing such information to the builder, nearby populace and the like during 
construction. 

If damage or failure should occur for some reason following the completion of 
the construction shown in the construction image information 201, this information 

10 may constitute important data for investigating the effects of the environment on the 
building in an investigation of causes and the like from the air temperature 203, 
humidity 204 and wind velocity 209. 

Fig. 3 shows an example in which process of manufacturing a food product 
that is imaged by a digital camera is expressed as image information in accordance 

15 with the present invention. In this food product image information 301, the conditions 
of the manufacturing process in a food processing plant, in which a processed 
beverage 310 is sealed in glass containers 307 on a conveyor 308, are displayed 
along with environmental information regarding the time 302, air temperature 303, 
humidity 304, intensity of ultraviolet radiation 312, degree of cleanness 305 and 

2 0 latitude and longitude 306. 

The environmental information indicates the following: first, the year, month 
and day of manufacture can be confirmed from the time 302, and the manufacturing 
plant can be confirmed from the location 306. As a result, in cases where some type 
of abnormality occurs in the shipped beverage product, the image information is 

2 5 effective in elucidating the causes of this abnormality. Furthermore, hygiene 

conditions, such as the possibility of the generation of bacteria or the like, can be 
ascertained from the air temperature 303, humidity 304, intensity of ultraviolet 
radiation 312 and degree of cleanness 305. In addition, the inspection conditions can 
be ascertained from the separating out of defective glass containers 31 1 . 
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Furthermore, such information leads to improved reliability of the product by the 
disclosure of information under normal circumstances, and not just in the case of 
abnormalities. 

Fig. 4 shows an example in which image acquisition means that can be used 
5 to create the image information of the present invention is provided in the form of a 
digital camera. The image acquisition means 401 consists of a digital camera which 
is equipped with an antenna 402. A GPS satellite wave is received by the antenna 
402, so that the position of the digital camera 401 can be ascertained in terms of 
longitude and latitude. Furthermore, the accurate imaging time is obtained by 

10 receiving a JJY standard frequency. 

Moreover, the image acquisition means 401 contains numerous types of 
sensors 403, and the air temperature, humidity, illumination, air pressure, altitude, 
degree of cleanness and the like are measured by these sensors 403. Such 
information can also be acquired from signals received by the antenna 402 rather 

15 than from the sensors 403. The digital camera 401 incorporates such information 
into the images at the time of imaging; furthermore, this image information may be 
sent to a storage destination via the internet or the like from the antenna 402. 

Fig. 5 shows an example in which the construction of the image acquisition 
means 401 shown in Fig. 4 is expressed as a block diagram. 

2 0 The images are input by means of an imaging device 501. For example, this 

imaging device 501 is a digital camera, digital video camera, DVD camera or the like. 
Simultaneously with image input, a standard frequency JJY indicating the standard 
time is received by a standard time signal receiver 504, and the time value of this 
signal is converted into an image signal format by a character converter 503. 

25 Similarly, a GPS satellite wave is received by a satellite wave receiver 512, latitude 
and longitude values are calculated from this wave signal by a calculator 513, and 
these values are converted into an image signal format by a character converter 514. 

Furthermore, signals are also input simultaneously with the image input from a 
temperature sensor 505 and a humidity sensor 508. The sensor outputs are 
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converted into digital numerical values by respective sensor amplifiers 506 and 509, 
and these values are converted into an image signal format by character converters 
507 and 510. Sensors may be added in accordance with the items that are to be 
measured. 

5 The output information signals 515 of the character converters 503, 507 and 

510 that convert the respective waves and sensor values into an image signal format 
are synthesized with the image signal 516 from the imaging device 501 by an image 
signal mixer 511, and all of this information is incorporated in the image, thus 
producing image information 517. The image information 517 is sent out from an 

10 image transmitter 502, and it is transferred via the internet. Alternatively, the image 
information 517 is stored in a read-only memory 518. In order to prevent falsification 
by the party performing the imaging, this memory 518 is constructed as a read-only 
memory which does not allow overwriting once writing has been performed. 

Fig. 6 is a model diagram illustrating the image information trading method of 

15 the present invention using a plant facility as an example. 

A piping plant 601 manufactures piping products 602 in accordance with 
orders from customers 607 (e. g., a generating plant). In the piping plant 601, 
inspection conditions for the completed piping product 602, or inspection conditions 
during manufacture, are imaged by a digital camera 603. The digital camera 603 can 

20 create image information according to the present invention, and piping image 

information 604, in which environmental information regarding the time of imaging 
and the position, air temperature and the like during imaging is incorporated into the 
acquired images, is generated for the commercial product. Information such as an 
image of a resolution evaluation sample acquired by the digital camera 603 for the 

25 purpose of correctly evaluating the resolution of the images, as well as camera 
identification data that specifies the digital camera 603 used for imaging, 
identification data that identifies the person performing the imaging and the like, is 
also added to this piping image information 604. 
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After this piping image information 604 has been subjected to anti-falsification 
processing, such as electronic signature processing as disclosed in "PGP Code Mail 
and Electronic Signatures, Encryption for Everyone" by Simson Garfinkel (O'Reilly 
Japan Inc.), or image watermark processing disclosed in "Electronic Watermarks and 
5 Protection of Contents" by Tsukasa Ono (Ohm-sha), the information is electronically 
transmitted to an image information managing company 605, where it is stored. 

However, if an electronic watermark or the like is added to the image portion 
of the image information, there may be cases in which the original image is lost, so 
that accurate processing results cannot be obtained by image processing. As a 

10 countermeasure against this problem, there are methods in which the imaging 

means is not provided with an image recording medium for preserving the captured 
image. In cases where there is no image recording medium for preserving the 
captured image in the digital camera 603, image information cannot be accumulated. 
Instead, the piping image information 604 is sent to the image information managing 

15 company 605 via the internet or the like immediately after imaging, and it is stored by 
this company. Accordingly, images do not remain at hand in the piping plant 601, 
and falsification is made impossible by the control of the image information 
managing company 605, so that the images constitute image information with a high 
degree of authenticity and reliability, and image processing is also possible. 

20 An independent inspection organization 606, which uses the image 

information 604 to perform an inspection for the presence or absence of surface 
defects in the piping product 602, acquires the image information 604 from the image 
information managing company 605 via the internet or the like in accordance with 
inspection requests from the piping plant 601 or customer 607, and it performs an 

25 inspection for surface defects using an image processing system 608. The results of 
the inspection processing are reported via the internet or the like to the piping plant 
601 or customer 607 where the request originated. 

In cases where defects are discovered in the inspection results, information 
regarding the defects is reported to the customer 607 via the internet together with 



an image of the sample surface that contains these defects. Since the customer 607 
can ascertain the quality of the product to be purchased according to the inspection 
results beforehand, the risk to which the customer 607 is exposed can be reduced; 
furthermore, in the case of the piping plant 601, since reliability can be ensured by 
5 selling the product with the inspection results appended to the product, the added 
value is increased. 

The flow of information in the abovementioned system will be described with 
reference to Fig. 7. 

First, a customer 607 places an order for the manufacture of a piping product 

10 from the piping plant 601 . The piping plant 601 images the piping product for which 
an order has been received at an intermediate stage during manufacture; and, upon 
completion of manufacture, the product is imaged by means of a digital camera 603, 
and the image information 604 is transmitted to the image information managing 
company 605 via the internet. 

15 The image information managing company 605 notifies the sender on the side 

of the piping plant 601 that the image data has been received, and then the piping 
plant 601, via the internet, changes a fee corresponding to the amount of transmitted 
image information 604. The piping plant 601 pays the requested fee to a designated 
financial institution, and the image information 604 is registered and stored at the 

2 0 time that this payment is confirmed. Furthermore, the charging and payment of fees 
need not be performed for each transmission of image information 604; such 
charging and payment may be performed periodically on a consolidated basis. 

Next, the piping plant 601 issues a request for inspection to the inspection 
organization 606 via the internet. After confirming that the piping plant 601 has been 

2 5 charged and that payment has been received from the piping plant 601 , the 

inspection organization 606 that has received the request for inspection orders the 
registered image information 604 from the image information managing company 
605 via the internet. 
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After charging a fee for the order received from the inspection organization 
606 and confirming that payment has been received, the image information 
managing company 605 transmits the image information 604 to the inspection 
organization 606 via the internet. The inspection organization 606, upon receiving 
5 the image information 604 from the image information managing company 605, 
performs an inspection for surface defects using an image processing system 608, 
and transmits the inspection results via the internet to the piping plant 601 where the 
request originated. 

The piping plant 601 that receives the inspection results also sends data 

10 regarding the inspection results received from the inspection organization 606 to the 
customer 607 via the internet at the time that the completed piping product is 
delivered to the customer 607. When the piping plant 601 receives notification of a 
passing inspection grade from the customer 607, the piping plant 601 submits a 
request for payment of charges, and the charges are paid by the customer. 

15 The procedure shown in Fig. 7 is one example, and the method and timing of 

billing and payment performed among the piping plant 601, image information 
managing company 805, inspection organization 606 and customer are not limited to 
this example. For example, buffing and payment need not be performed at the time 
of each request or order; rather, such billing and payment may be handled 

2 0 periodically on a consolidated basis. Furthermore, data regarding inspection results 
need not always be sent via the internet at the time that the completed product is 
delivered to the customer 607 from the piping plant 601 ; for example, data in hard 
copy form may be appended at the time that the product is delivered. 

Fig. 8 shows the flow of data in the system shown in Fig. 6 in a state in which 

2 5 the image information managing company 605 and inspection organization 606 are 
integrated. 

In this case, the piping plant 601, upon receiving an order from the customer 
607, sends a request to an image information managing/inspection company 609 (in 
which the image information managing company 605 and inspection organization 
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606 in Fig. 8 are integrated) to perform an inspection of the ordered piping product in 
an intermediate stage of manufacture, as well as in the stage of the completed 
product. 

After charging a fee and receiving payment from the piping plant 601 where 
5 the request originated, the image information managing/inspection company 609 
receives image information 604 for use in inspection from the piping plant 601 , 
performs an inspection for surface defects using the image processing system 608 
shown in Fig. 6, and transmits the inspection results via the internet to the piping 
plant 601 where the request originated. 

10 The piping plant 601 that receives the inspection results also sends data 

concerning the inspection results received from the inspection organization 606 to 
the customer 607 via the internet at the time that the completed piping product is 
delivered to the customer 607. When the piping plant 601 receives notification of a 
passing inspection grade from the customer 607, the piping plant 601 submits a 

15 request for payment of charges, and the charges are paid by the customer. 

In the example shown in Fig. 8, as in the example shown in Fig. 7, the method 
and timing of billing and payment performed among the piping plant 601, image 
information managing/inspection company 609 and the customer are not limited to 
this example. 

20 Fig. 9 shows one example of the flow of data in a case where a piping product 

that has been purchased from the piping plant 601 and is periodically inspected 
during use. 

After confirming payment from the customer 607, the inspection organization 
606 that has received an inspection request from the customer 607 orders image 
25 information 604 for the corresponding product from the imaging information 

managing company 605. The imaging information managing company 605 that 
receives this order transmits to the inspection organization 606 image information 
604 for the corresponding product that has been stored and image information 604 
for the same product that is newly acquired by the digital camera 603. 



Here, by referring to information relating to the imaging environment recorded 
in the image information 604 for the corresponding product that has been stored, 
when new image information 604 for the product is acquired by the digital camera 
603, it is possible to acquire image information 604 for the product at the current 
5 point in time in the same imaging environment as that of the image information 604 
that has been stored. 

The inspection organization 606 that has received the image data performs an 
inspection for surface defects using the image processing system 608 shown in Fig. 
6, and it transmits the inspection results via the internet to the customer 607 that 

10 originated the request. The customer 607 receiving the inspection results can 

continue to use the piping product after confirming the safety of the piping product. 
Furthermore, in accordance with the demands of the customer 607, the inspection 
company 606 can also retrieve previous inspection results corresponding to the 
current inspection results from the storage means (data server), and it can send 

1 5 these previous inspection results to the customer 607 as data that is appended to 
the current inspection results. 

In the example shown in Fig. 9, the imaging information managing company 
605 and inspection organization 606 were described as separate organizations; 
however, it would also be possible to combine these into a single organization as in 

2 0 the case of the image information managing/inspection company 609 considered in 
the example illustrated in Fig. 8. In this case, the customer 607 sends a request for 
inspection to a company A (not shown in the figures) such as the image information 
managing/inspection company 609 shown in Fig. 8. Company A that receives this 
request performs an inspection for surface defects using product image data stored 

2 5 at its own location and product image data that has been newly acquired using the 
digital camera 603, this inspection being accomplished by means of the image 
processing system 608 shown in Fig. 6. Company A then transmits the inspection 
results via the internet to the customer 607 that originated the request. 
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The request for inspection that is sent to the inspection organization 606 may 
also come from a third party other than the piping plant 601 or customer 607. For 
example, in a case where the customer 607 is a nuclear power generating plant, a 
request for inspection may also be made by persons having doubts regarding the 
5 facility, such as the surrounding populace or the like. Furthermore, it would also be 
possible to acquire image information 604 directly from the image information 
managing company 605 without sending a request to the inspection organization 
606, and to perform independent inspection processing. The image information 
managing company 605 is operated by obtaining payment for the management of 

10 the image information 604 from the originator of requests for this image information 
604, e. g., the piping plant 601 , the customer 607 or the like. 

By using such a system, it is possible to achieve an increase in the efficiency 
of inspections in fields where large machined products, cast products or the like are 
repeatedly inspected. 

15 Fig. 10 shows one embodiment of an image information search system 

constructed according to the present invention. 

Here, image information is collected and managed in an image information 
memory device 702 at a image information managing company 701. The image 
information managing company is operated on the basis of charges for managing the 

20 information and transaction sales figures. In cases where only desired image 
information is to be extracted from the image information held by the image 
information managing company 701 , an image information search system 703 
provided by the image information managing company is used. The image 
information search system 703 can be called up and operated from a PC 707 that is 

2 5 connected to the image information managing company 701 via the internet 706. 
When the image information search system 703 is operated, a table of information 
items 705 is displayed. Information constituting key words is selected from these 
information items 705, and the content is input. For example, in cases where a 
confirmation of a surface inspection is to be performed for a purchased piping 
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product, the location of the plant where the piping was manufactured and the 
approximate date and time are input into the image information search system 703. 

The image information search system 703 that has received a search 
command searches for image information candidates that match the input 
5 information in the image information memory device 702, and it displays simple 

images of the candidate image information as search results 704 on the PC 707 that 
requested the search. 

As another search example, there may be cases in which a quality check of 
piping for which delivery is planned is performed. In cases where the effects of 

10 humidity during a certain period on the product in question are to be investigated, 
this can be accomplished by selecting the location of the manufacturing plant, the 
time of manufacture and the humidity from the information items 705 of the image 
information search system 703, and inputting arbitrary numerical values. In cases 
where the desired image information is found in the search results 704, this image 

15 information is purchased from the image information managing company 701. In the 
case of image information whose purchase is desired by a transaction partner, the 
image information managing company 701 sells the complete image information to 
the transaction partner via the internet 706. The party that receives the complete 
image information can perform various types of inspections on the basis of the image 

20 information, either visually or by using image processing. 

Fig. 11 shows one embodiment in which the image information of the present 
invention is applied to the prevention of image falsification. 

Like Fig. 1, Fig. 11 shows in view (a) installation image information 101 for 
metal piping 109 on which a penetrating damage-locating test treatment has been 

2 5 performed, and which has been imaged by means of a digital camera for the 

purpose of making an inspection for welding defects in the welding marks 110. Fig. 
1 1 shows in view (b) watermark digital image information 1 101 for an electronic 
watermark constituting one procedure of anti-falsification means for digital images. 



18 



Fig. 11 shows in view (c) image information 1106 in which the electronic watermark 
of view (b) is embedded in the installation image information 101 of view (a). 

An electronic watermark is something that is embedded by (for example) 
adding known data to the entire surface of an image for which the prevention of 
5 falsification is desired. In cases where the image is falsified following the embedding 
of the watermark, the falsification can be detected by virtue of the fact that the 
embedded information is changed when the embedded information is read out. The 
watermark processing may use the Primary Watermark technique of the Galaxy 
Group (joint proposal by IBM, NEC, SONY and Hitachi). 

10 The watermark digital image information 1 101 expresses the embedded 

information as image information. The embedded information of the watermark 
digital image information 1101 comprises altitude information 1102 and air pressure 
information 1 103 for the place where the installation image information 101 of view 
(a) was imaged, graphic information 1 104 which shows an approval seal that notes 

15 the date of the penetrating damage locating test performed on the welding marks 
110 of the installation image information 101, and shade information 1105 which 
uses a numerical value determined by the coordinates of the image in the 
background as a brightness density value. Furthermore, in the shade information 
1 105, the positions where the numerical value data of the altitude information 1 102 

2 0 and air pressure information 1 1 03 are embedded as several bits of embedded 
information may be determined and disposed using statistical procedures. 

Judgement of the possible falsification of the image information 1 106 in which 
an electronic watermark is embedded is accomplished as follows: namely, digital 
image information corresponding to the watermark digital image information 1101 is 

2 5 read out from the image information 1 106 (following watermark embedding) by 

performing processing that is the opposite to that of the processing that embedded 
the watermark digital image information 1101, and the embedded information of the 
read-out digital image is compared with the known information that is embedded in 
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the watermark digital image information 1101. If these two sets of information 
disagree by even one bit, it is judged that falsification has occurred. 

In the case of the image information 11 06 in which the electronic watermark of 
view (c) is embedded, the embedded watermark information is in a visible state. 
5 However, it would also be possible to embed this information in an invisible state. In 
this case, the resistance of the image in processing such as rotation or enlargement 
of the image is weakened however, the information may have reversibility that allows 
reproduction of the image prior to embedding. 

Fig. 12 shows one embodiment of image acquisition means that can create 

10 image information to be used in the prevention of image falsification in accordance 
with the present invention. 

Here, a defect inspection device 1202 that performs a penetrating damage- 
locating test, inputs digital image data that images an inspection area that has been 
coated with a penetrating liquid and a developing agent from an imaging device 

15 1201, such as a digital camera or the like. In the defect inspection device 1202, 
electronic watermark processing is performed on the image data immediately 
following image input. For example, the embedding position of 8-bit embedded 
information 1209, such as preset characters, figures or the like, is determined by the 
embedding position calculating part 1210 using a statistical procedure. In the 

20 watermark embedding part 1203, the embedded information is embedded in the 
input image according to the data of the embedding position calculating part 1210. 

Since the electronic watermark used in the present device is used for the 
purpose of detecting falsification, this watermark need not have any resistance to 
processing, such as image alteration, editing, compression or the like, and a 

25 watermark of the invisible and low-resistance type, in which there is no great change 
in the input image data, is desirable. As a result of the embedding of this electronic 
watermark, the presence or absence of image falsification can be detected by the 
defect inspection device 1202. 
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Next, the image data that has been subjected to electronic watermark 
processing is inspected for the presence or absence of defects in a penetrating 
damage-locating test performed by the defect inspection part 1204. In cases where 
defects are found, inspection results, such as the location and size, area, shape, 
5 hue, saturation, brightness and the like of the defects, are stored in memory, and the 
defect inspection results are displayed on a display device 1208, such as a monitor 
or the like. Afterward, the image data that has been subjected to image falsification 
preventive processing is transmitted along with the defect inspection results to other 
locations from the transmitting and receiving part 1205 via a network 1206 or the 

10 like. Furthermore, the transmitting and receiving part 1205 also receives image data 
sent from other locations. 

The received image data is checked for the presence or absence of 
falsification by the falsification detection part 1207. In the case of this image data, 
embedded information is read out for image data (in which the electronic watermark 

15 has been processed) by the falsification detection part 1207. In cases where read- 
out is impossible, or in cases where the information that is read out differs from the 
known embedded information 1211, it is judged that the image in question has been 
falsified. 

The results of this check for the presence or absence of falsification are 
2 0 displayed on the display device 1208 (such as a monitor or the like). Furthermore, for 
received images that are free of falsification, defect inspection processing of the 
abovementioned penetrating damage-locating test is performed by the defect 
inspection part 1204. 

An electronic signature (or digital signature) using a hush function instead of 
25 the electronic watermark technique can also be used as a tool to prevent the 
falsification of the digital image data. 

By thus using image acquisition means that can create the image information 
according to the present invention as image information that prevents the falsification 
of images, it is possible to guarantee freedom from image falsification in digital 
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images that are easily falsified and thus ordinarily lack reliability. Accordingly, such 
images and defect inspection results for these images can be endowed with a high 
degree of reliability, and visual inspections, such as penetrating damage-locating 
tests and the like, can be replaced by indirect visual inspections using images. 
5 Fig. 13 shows one embodiment of an inspection report to which image 

information of the present invention is appended. 

The results of a damage-locating test inspection of the welded parts in a 
piping product 1304 are displayed in the format of an inspection report 1302 on a 
monitor screen 1301. The format of the inspection report 1302 includes the product 

10 name, part name, manufacturing serial number, drawing number, document number, 
place of inspection, month of inspection and the name of the inspector. Below, the 
judgement results for good parts and defective parts are displayed as inspection 
results along with the inspection date for each drawing number of the piping product. 
If there are no defects in the welded state so that the part is good, "good" is 

15 displayed in the column for the judgement results. Furthermore, the presence or 
absence of image information imaging each piping part is displayed in the image 
presence or absence column 1310. 

In cases where the image presence or absence column 1310 displays 
"present", this indicates that one or more sets of image information relating to the 

20 inspection results are linked with the inspection report 1302. When this image 

presence or absence column 1310 is clicked on by the cursor 1305, the image data 
display window 1303 displays the image information for the piping part 1304 that is 
stored in memory along with the inspection report 1302. 

Furthermore, in the detail window 1307, details of the welded state of the 

25 piping part 1304 are displayed in an enlarged form. The detail window 1307 shows 
an enlarged display of the region indicated in the detail display range 1306 of the 
image data display window 1303. A scroll bar 1309 is provided in the detail image 
window 1307, and arbitrary welded portions can be displayed by moving this scroll 
bar to the left or right using the cursor 1305. By observing the welded state 1308 of 
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the piping product 1304 that is the object of inspection in images in which these 
welded parts are enlarged, it is possible to reproduce in these images the conditions 
under which a judgement of good or defective was made in the inspection report 
1302. 

5 If an inspection report to which the image information according to the present 

invention is appended is used, the addition of image information to an inspection 
report consisting only of character information makes it impossible to report false 
inspection results, so that the inspection report can be endowed with a high degree 
of reliability. 

10 The present invention can solve the following conventional problems: 

(1) By adding image time information and position information indicating 
the imaging location, as well as environment information, such as the air 
temperature, humidity and the like at the time of imaging, to the same image, image 
information with high reliability and a high added value can be obtained, and this 

15 information can be utilized as information for non-destructive inspections using 

images, monitoring of various types of manufacturing processes, and other types of 
process monitoring. 

(2) In image acquisition means, such as a digital camera or the like, by 
eliminating an image memory medium, such as flash memory or disk memory, for 

20 preserving the captured image information and transmitting the image information to 
a data managing company immediately following imaging, it is possible to eliminate 
any possibility of falsification by the person performing the imaging or the like, so that 
the authenticity of the images is guaranteed and highly reliable image information is 
obtained. 

25 (3) By adding image information recording the manufacturing process, 

inspection conditions and the like to products, it is possible to back up the product 
quality, so that the products can be endowed with a high degree of reliability. 

The invention may be embodied in other specific forms without departing from 
the spirit or essential characteristics thereof. The foregoing embodiments are 
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therefore to be considered in all respects as illustrative and not restrictive, the scope 
of the invention being indicated by the appended claims, rather than by the foregoing 
description, and all changes which come within the meaning and range of 
equivalency of the claims are therefore intended to be embraced therein. 



